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FIELD OF THE INVENTION 

The invention relates to a method and arrangement for embedding a 
watermark in an information signal. More particularly, the invention relates to embedding a 
watermark in a motion video signal. 

5 

BACKGROUND OF THE INVENTION 

Watermarking is a technique to certify the ownership of (digital) information 
content. By imperceptibly hiding a watermark into the content, it is possible to prevent piracy 
and illegal use of this content. Typical applications include copy protection for digital audio 

10 and video, and broadcast monitoring. 

The watermark, typically a given pseudo random noise sequence, is usually 
added to the content in the original (temporal or spatial) signal domain. Most presently used 
watermark detection methods are based on correlating the suspect signal with the pseudo 
random noise sequence. If the correlation exceeds a given threshold, the watermark is said to 

15 be present. 

An example of a prior art watermark embedding method is disclosed in 
Intemational Patent Application WO-A-99/45707. The prior art method relates to 
watermarking a motion video signal. For complexity reasons, the same watermark is 
embedded in every image (field or frame) of the video signal. To reduce the complexity even 
20 more, a small watermark pattern is tiled over the image. A typical tile size is 128x 128 pixels. 
At the detection side, the tiles of a nximber of images are folded into a 128x128 buffer. 
Detection is then performed by correlating the buffer contents with the small watermark 
pattern. 

The pseudo random noise sequence is a secret key. When a hacker has 
25 knowledge of the sequence and the embedding algorithm, he can obtain an estimate of the 
embedded watermark, for example, by adding a large number of tiles. He can then remove 
the watermark by subtracting the estimated sequence from the watermarked signal. 



Q 



B)6^S hNL000349EPP l^^^f, 



™ * 



10 



15 



20 



25 



30 



2 14.6.2000 
OBJECT AND SUMMARY OF THE INVENTION 

It is an object of the invention to provide a method and arrangement for 
embedding a watermark in a more secure manner. 

To this end, the method of embedding a watermark in an information signal is 
characterized by embedding different versions of said watermark in successive portions of 
the infonnation signal, said versions being different with respect to a property which is 
irrelevant for detection of said watermark. 

The invention exploits the insight that detection methods are often invariant 
with respect to predetermined properties of the embedded watermark. For example, the prior 
art detection method disclosed in the above-cited International Patent Application 
WO-A-99/45707 is invariant with respect to the magnitudes of the Fourier transformed 
image. In accordance herewith, the magnitudes of the Fourier coefficients of the watermark 
are chosen randomly in a first embodiment of the invention. 

The prior art detection method is also shift invariant. Accordingly, the step of 
generating different versions of the watermark includes randomly shifting (for example, at a 
low temporal fi-equency) the spatial position of the watermark with respect to the video image 
in a second embodiment of the invention. 

Another watermark detection method, proposed in Applicant's European 
Patent Application 99203143.5 (not yet published) is invariant to scaling and rotation of the 
embedded watermark. In combination with such a detector, the embedded watermark may be 
randomly scaled and/or rotated. 

With the invention is thus achieved that a range of watennarks are embedded, 
which are different in the signal domain but will be seen as the same by the detection 
algorithm. 

UK Patent Application GB 2 325 765 discloses a method of hiding data in a 
video signal, in which method frame patterns of differing block patterns are embedded in the 
video frames. A random element is introduced into a block pattern. More particularly, a 
specific block pattern is randomly added to and subtracted from the video signal at thl same 
location of each frame. A detection pattern is used that does not include the random element, 
random element. The random element causes +1 or -1 to appear at r^dom at the output of 
the detector. The detector does not appear to be invariant with respect to the sign of the 
embedding operation. This prior art document does not therefore not disclose randomizing a 
property which is irrelevant for detection of the watemiark. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a schematic diagram of a first embodiment of an arrangement for 
embedding a watermark in a video signal in accordance with the invention. 
5 Fig. 2 shows a diagram to illustrate the operation of a payload encoder which 

is shown in Fig. 1 . 

Fig. 3 shows a watermark embedded in a video signal by the arrangement 
which is shown in Fig. 1 . 

Figs. 4 and 5 show alternative embodiments of the arrangement which is 
10 shown in Fig. 1. 

Fig. 6 shows a watermark embedded in a video signal by the arrangements 
which are shown in Figs. 4 or 5. 

Fig. 7 shows a schematic diagram of an arrangement for detecting a watermark 
in a suspect video signal. 
1 5 Figs. 8 A and 8B show correlation patterns to illustrate the operation of the 

detector which is shown in Fig. 7. 

Fig. 9 shows a schematic diagram of a second embodiment of an arrangement 
for embedding a watermark in a video signal in accordance with the invention. 

Fig. 10 shows a watermark embedded in a video signal by the arrangement 
20 which is shown in Fig, 9. 

Figs. 1 1 A and 1 IB show correlation patterns to illustrate the operation of the 
detector which is shown in Fig. 7. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

25 The invention will be described with reference to embedding a watermark in 

motion video signals. It will be appreciated that the description may equally be applied to 
other types of information signals. Fig. 1 shows a schematic diagram of a first embodiment of 
an arrangement in accordance with the invention. The arrangement is a further improvement 
of the embedder disclosed in Intemational Patent Application WO-A-99/45707. 

30 The arrangement receives a motion video signal X and outputs a watermarked 

video signal Y. It comprises a payload encoder 10, a property randomizer 11, a tiling circuit 
12, and an adder 13. Fig. 2 illustrates the operation of the payload encoder 10. A watermark 
pattern W is obtained by adding a limited set of uncorrelated "basic" watermark patterns 
(Wl, W2) and cyclically shifted versions (W2k) thereof. In this example, the encoder 10 
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generates W=Wl+W2-W2k, where W2k is a cyclically shifted version of basic pattern W2. 
The signs and shift vectors (k) represent a payload K. To reduce complexity, the watermark 
pattern W has a relatively small size of MxM (e.g. 128x128) pixels. It is tiled over the larger 
NlxN2 image area by the tiling circuit 12. In the prior art arrangement, the same watermark 
5 tile W is tiled over the image. Moreover, the same v^atermark WM is embedded in successive 
frames of a motion video signal. 

The arrangement, v/hich is shown in Fig. 1, includes a property randomizer 11. 
The watermark tile W to be embedded is herein subjected to a Fast Fourier Transform 110. 
The Fourier coefficients have a magnitude abs and a phase cp. The magnitudes abs are 
10 randomized (or replaced by random magnitudes) by a randomizing circuit 111. The 

randomized magnitudes abs* and original phases (p are then back-transformed to the spatial 
domain by an inverse Fast Fourier Transform 112. The watermark tile W* thus produced 
differs from the watermark tile W in the spatial domain 

The property randomizer 11 produces a different watermark pattem W for 
1 5 each tile of the image. Fig. 3 shows the watermark WM after the tiling operation 12. In this 
Figure, the property which is irrelevant for the detection process (i.e. the magnitudes of the 
Fourier coefficients) is represented by the line style. This property differs from tile to tile. 
The property which is relevant for the detection process (i.e. the phases of the Fourier 
coefficients) is represented by the respective symbols and is the same for each tile. The 
20 watermark tiles are different in the spatial domain and therefore difficult to hack. 

Fig, 4 shows an alternative embodiment of the watermark embedder with 
which the same effect is achieved. This embodiment differs from the one which is shown in 
Fig. 1 in that the property randomizing operation is individually applied to the basic 
watermark patterns Wl and/or W2 before encoding the payload. For each basic watermark, a 
25 respective property randomizer 13,14 is used which is similar to randomizer 11 in Fig. 1. 

Fig, 5 shows a variant of this embodiment. Herein, the basic watermark 
patterns are defined in the Fourier domain rather than the spatial domain. More particularly, 
the basic watermarks Wl and W2 are defined in terms of the phases <p of Fourier coefficients. 
The respective property randomizers 15,16 no longer need to have Fast Fourier Transform 
30 circuits (cf 110 in Fig. 1). The magnitudes or the Fourier coefficients are now randomly 
generated by random generators 151 and 161, respectively. 

It should be noted that the property randomizers 13,14 (Fig. 4) and 15,16 
(Fig. 5) need not be physically present in the respective embedders. It is possible to pre-store 
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a plurality of randomized versions of each basic watermark pattern in the embedder. In that 
case, the embedder (randomly) selects one of the stored versions for each image tile. 

Fig. 6 shows the tiled watermark WM generated by the embodiments shown in 
Figs. 4 and 5. The watermark differs from the one which is shown in Fig. 3 in that the basic 
5 pattern Wl on the one hand, and the pattems W2 and W2k on the other hand, are differently 
randomized. 

For completeness of the disclosure of the invention, the operation of the 
watermark detector will now briefly be summarized. A more detailed description can be 
found in Intemational Patent Application WO-A-99/45707. Fig. 7 shows a schematic 
10 diagram of the arrangement. The detector partitions (20) each image of a suspect video signal 
Q into blocks of size MxM (M=128) and stacks (21) all the blocks in a buffer B of size 
MxM. This operation is known as folding. To detect whether or not the contents q of the 
folding buffer B includes a particular (possibly shifted) basic watermark pattern w (Wl or 
W2), the buffer contents and said basic watermark pattern are subjected to correlation. Both 
15 the contents q of the buffer and the basic watermark pattem w are subjected to a Fast Fourier 
Transform (FFT) in transform circuits 22 and 23, respectively. These operations yield: 

q = FFT(q) and 
w = FFT(w) , 

where q and w are sets of complex ntmibers. Computing the correlation is similar to 
20 computing the convolution of q and the conjugate of w. In the transform domain, this 
corresponds to: 

d = q®conj(w) 

where the symbol ® denotes pointwise multiplication and conJO denotes conjugation. The 
conjugation (inverting the sign of the imaginary part) of w is carried out by a conjugation 
25 circuit 24, and the pointwise multiplication is carried out by a multiplier 25. Note that FFT 23 
and conjugation 24 of the applied watermark W can be pre-computed and stored in a 
memory. 

The Fourier coefficients d are complex numbers. As disclosed in Intemational 
Patent Application WO-A-99/45707, the reliability of the detector is significantly improved if 
30 the magnitude information is thrown away and the phase is considered only. To this end, the 
detector includes a magnitude normalization circuit 26, which pointwise divides each 
coefficient by its magnitude: 

d:=dcDabs(d) 
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where O denotes pointwise division. 

An MxM pattern of correlation values d={dk} is now obtained by inverse 
Fourier transforming the result of said multiplication: 



d = IFFT(d) 



5 which is carried out by an inverse FFT circuit 27. The basic watermark pattern W is detected 
to be present if a correlation value dk is larger than a given threshold. Fig. 8A shows that the 
MxM correlation pattern exhibits a strong positive peak 80 at the origin (0,0), if the basic 
watermark Wl is applied to the arrangement. The location (0,0) of the peak indicates that the 
spatial position of the applied watermark pattern corresponds to the spatial position of the 

10 embedded watermark in the folding buffer. Fig. 8B shows that the correlation pattern exhibits 
a strong positive peak 81 at the origin (0,0) and a strong negative peak 82 at another location, 
if the basic watermark W2 is applied to the arrangement. The relative distance between, and 
the signs of, peaks 81 and 82 represent the shift vector k. A payload decoder 28 (Fig. 7) 
identifies said shift vector k and decodes the corresponding payload data K. 

15 A potential hacker will obtain an estimate of the phases of the watermark 

when he adds a large number of tiles. He may mislead the detector by choosing random 
magnitudes for the watermark and then subtracting the estimated watermark from the 
watermarked video signal. However, this will introduce artifacts because the embedded 
watermark is spatially different fi-om the estimated watermark. 

20 Fig. 9 shows a schematic diagram of a further embodiment of the watermark 

embedder in accordance with the invention. In this embodiment, the property of the 
watermark WM being randomized is its spatial position with respect to the image area. To 
this end, the arrangement comprises a position randomizer 19. In this example, the 
randomizer is located between the tiling circuit 12 and the adder 13. Alternatively, the 

25 randomizer may be positioned between payload encoder 10 and tiling circuit 12. 



been cyclically shifted by a vector s compared with the watermark WM shovra in Figs. 3 and 
6. Advantageously, the position is modified fi-om frame to frame at a relatively low 
frequency. Figs. 1 1 A and 11 B show the MxM correlation pattems if the basic watermark 
30 pattems Wl and W2, respectively, are applied to the detector. The peaks 80-82 have been 
shifted by the vector s compared with the peaks shown in Figs. 8A and 8B. However, the 
relative distance between, and the signs of, the peaks representing the shift vector k (and thus 
the payload data K) have not been changed. 



Fig. 10 shows a tiled watermark WM' generated by this embodiment. It has 
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The above described embodiments (randomizing of magnitudes and 
randomizing of position) may advantageously be combined. 

An arrangement for embedding a watermark in an information signal is 
disclosed. In order to make the embedded watermark more robust against hacking, a property 
5 of the watermark is randomized (11) which is irrelevant for the watermark detection. One 
example is randomizing (1 1 1) the magnitudes (abs) of the Fourier transformed watermark. 
Another example is randomly shifting the spatial or temporal position of the watermark with 
respect to the signal at a relatively low temporal frequency. The invention allows embedding 
(13) of spatially different watermarks without affecting the performance of a detector. 
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5 

1 . A method of embedding a watemiark in an inforaiation signal, characterized 
by embedding different versions of said watermark in successive portions of the information 
signal, said versions being different with respect to a property which is irrelevant for 
detection of said watermark. 

10 

2. A method as claimed in claim 1, comprising the step of randomizing the 
magnitudes of the Fourier coefficients of said watermark. 

3. A method as claimed in claim 2, wherein the watermark includes at least one 
15 basic watermark pattern being tiled over the portion of the information signal, said step of 

randomizing the magnitudes being applied to the Fourier coefficients of said basic watermark 
pattern. 

4. A method as claimed in claim 1, comprising the step of randomizing the 
20 position of the watermark with respect to the respective portion of the information signal. 

5. A method as claimed in claim 1, wherein said successive portions of the 
information signal are successive frames of a motion video signal. 

25 6. An arrangement for embedding a watermark in an information signal, 

comprising means for embedding different versions of said watermark in successive portions 
of the information signal, said versions being different with respect to a property which is 
irrelevant for detection of said watermark. 



30 7. An arrangement as claimed in claim 6, comprising means for randomizing the 

magnitudes of the Fourier coefficients of said watermeirk. 

8. An arrangement as claimed in claim 6, comprising means for randomizing the 

position of the watermark with respect to the respective portion of the information signal. 
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9. An arrangement as claimed in claim 6, wherein said successive portions of the 
information signal are successive frames of a motion video signal. 

10. An information signal with an embedded watermark, characterized in that 

5 successive portions of said signal have different versions of said watermark embedded, said 
versions being different with respect to a property which is irrelevant for detection of said 
watermark. 
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An arrangement for embedding a watermark in an information signal is 
disclosed. In order to make the embedded watermark more robust against hacking, a property 
of the watermark is randomized (11) which is irrelevant for the watermark detection. One 
example is randomizing (1 11) the magnitudes (abs) of the Fourier transformed watermark. 
5 Another example is randomly shifting the spatial or temporal position of the watermark with 
respect to the signal at a relatively low temporal frequency. The invention allows embedding 
(13) of spatially different watermarks without affecting the performance of a detector. 

Fig. 1. 
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